What are you looking at? Gaze estimation in medium-scale images
نویسندگان
چکیده
In this paper we describe a new method for estimating where a person is looking in images where the head of a person is typically 20 pixels high. We use a feature vector based on skin detection to estimate the orientation of the head, which is discretised into 8 different orientations, relative to the camera. A fast sampling method returns a distribution over head pose. The general direction of the person is estimated based on velocity. We show that, by combining direction and head pose using a Bayesian Network gaze is determined more robustly than using each feature alone. We demonstrate this technique on surveillance and sports footage.
منابع مشابه
What Are You Looking at? Improving Visual Gaze Estimation by Saliency
In this paper we present a novel mechanism to obtain enhanced gaze estimation for subjects looking at a scene or an image. The system makes use of prior knowledge about the scene (e.g. an image on a computer screen), to define a probability map of the scene the subject is gazing at, in order to find the most probable location. The proposed system helps in correcting the fixations which are erro...
متن کاملLast but not least
One of the key aspects of face processing in primates is the estimation of gaze direction (Hinde and Rowell 1962; Kleinke 1986). Studies of how our visual systems achieve their remarkable levels of accuracy at this task have revealed that besides the overall orientation of the stimulus head, the stimulus eyes appear to be crucially important (Perrett et al 1985; Baron-Cohen et al 1995; von Gru«...
متن کاملWAYLA - Generating Images from Eye Movements
We present a method for reconstructing images viewed by observers based only on their eye movements. By exploring the relationships between gaze patterns and image stimuli, the “What Are You Looking At?” (WAYLA) system learns to synthesize photo-realistic images that are similar to the original pictures being viewed. The WAYLA approach is based on the Conditional Generative Adversarial Network ...
متن کاملP14: How to Find a Talent?
Talents may be artistic or technical, mental or physical, personal or social. You can be a talented introvert or a talented extrovert. Learning to look for your talents in the right places and building those talents into skills and abilities might take some work, but going about it creatively will let you explore your natural abilities and find your innate talents. You’re not going to fin...
متن کاملJoint perception: gaze and social context
We found that the way people looked at images was influenced by their belief that others were looking too. If participants believed that an unseen other person was also looking at what they could see, it shifted the balance of their gaze between negative and positive images. The direction of this shift depended upon whether participants thought that later they would be compared against the othe...
متن کامل